Hand Gesture Recognition and Conversion to Speech for Speech Impaired

نویسندگان

چکیده

The primary method of interaction between individuals is communication. In the case speech-impaired people, communication them and normal people not understandable by latter as former communicates through gestures sign language. speech-impaired. Today, Internet Things (IoT) can be used for gesture recognition to convert into audible speech. this project, a prototype created such that or language communicated recognized flex sensors connected fingertips plain glove. ESP32 microcontroller recognizes converts it text format updated onto Google Firebase converted speech form thus producing OLED display sensor in mobile application Kodular Companion.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Combined Hand Gesture — Speech Model for Human Action Recognition

This study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and speech models is considered by integrating speech recognition technology with a multimodal model, thu...

متن کامل

Developing a Standardized Medical Speech Recognition Database for Reconstructive Hand Surgery

Fast and holistic access to the patients’ clinical record is a major requirement of modern medical decision support systems (DSS). While electronic health records (EHRs) have replaced the traditional paper-based records in most healthcare organization, the data entry into these systems remains largely manual. Speech recognition technology promises substitution of the more convenient speech-base...

متن کامل

Combine Approach for Speech and Gesture Recognition

Gesture and Speech based human Computer interaction is attractive attention across various areas such as pattern recognition, computer vision. Thus kind of research areas find many kind of application in Multimodal HCI, Robotics control, Sign language recognition. This paper presents head and hand Gesture as well as Speech recognition system for human computer interaction (HCI).This kind of vis...

متن کامل

Using Handwriting and Gesture Recognition to Correct Speech Recognition Errors

To provide a natural interface to the computer, we have developed an integrated speech, gesture, and handwriting recognition system. By integrating the technologies, we can easily accomplish, most, if not all, of the tasks that are needed to use computers and their applications, including many tasks which neither technology can adequately perform by itself. This integrated environment not only ...

متن کامل

Automatic Speech Recognition with Deep Neural Networks for Impaired Speech

Automatic Speech Recognition has reached almost human performance in some controlled scenarios. However, recognition of impaired speech is a difficult task for two main reasons: data is (i) scarce and (ii) heterogeneous. In this work we train different architectures on a database of dysarthric speech. A comparison between architectures shows that, even with a small database, hybrid DNN-HMM mode...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: E3S web of conferences

سال: 2023

ISSN: ['2555-0403', '2267-1242']

DOI: https://doi.org/10.1051/e3sconf/202339101148